A Unified Approach to Shot Change Detection and Camera Motion Characterization P. Bouthemy, M. Gelgon and F. Ganansia

This paper describes an original approach which jointly addresses two fundamental issues of video partitioning which represent the early important stage of any content-based video indexing system. These two issues are the detection of shot changes, and the labeling of the shot connguration related to the camera movement in terms of static shot, panning, traveling, zooming,... They are both derived from the computation, at each time instant, of the dominant motion in the image represented by a 2D aane model, and from the variation of the size of its associated support. The successive steps of the method rely on statistical techniques ensuring robustness and eeciency. In particular, it can cope with scenes containing moving objects. Results on a real documentary video are reported and validate the proposed approach. Une approche unii ee pour la d etection de changement de plan et la caract erisation du mouvement de cam era R esum e : Nous d ecrivons une approche traitant conjointement deux probl emes fonda-mentaux du partitionnement de vid eo en plan, la d etection des changements de plan et l' etiquetage d'une connguration de plan reli e a un mouvement de cam era en termes de plan xe, traveling, zoom... Il s'agit d' une premi ere etape importante pour tout syst eme d'indexation de vid eo par le contenu. La m ethode propos ee exploite, pour les deux aspects du probl eme, l'estimation du mouvement dominant dans l'image, repr esent e par un mod ele aane 2D, et de l' evolution temporelle du support associ e. Les etapes successives de cette m ethode reposent sur des techniques statistiques, qui en assurent la robustesse et l'eecacit e. Mots cl es : D ecoupage en plan, Mouvement de cam era, Indexation vid eo A uniied approach to shot change detection and camera motion characterization 3 1 Introduction and related work